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INTRODUCTION 


The  degree  of  sophistication  of  Army  fire  control  on-board  electronic  sys¬ 
tems  has  Increased  dramatically  during  the  post-Vietnam  era.  During  the  1980s, 
the  Army  Modernization  Program  has  sought  to  use  state-of-the-art  mini  and  micro¬ 
computer  technology  to  a  maximum.  Some  systems  that  exemplify  this  policy 
include  the  ABRAMS  tank,  the  Bradley  Fighting  Vehicle,  the  SGT  York  Division  Air 
Defense  Gun,  and  the  APACHE  helicopter.  Maintenance  manuals  for  a  tank  can 
require  60,000  pages  of  documentation.  Given  this  increase  in  complexity,  there 
exists  a  corresponding  need  to  provide  tools  to  deal  with  the  maintenance  of 
these  systems. 

A  major  expert  system  currently  under  development  in  the  maintenance  and 
diagnostic  environment  is  BITE  (United  States  Army).  BITE  is  an  all  encompassing 
electronic  malfunction  diagnostic  system  for  combat  ground  vehicles.  The  date  of 
delivery  is  1990.  One  of  the  contributions  of  BITE  will  be  to  study  two  differ¬ 
ent  user  interface  techniques:  audible  information  and  visual  display.  MAD1DA 
(maintenance  and  diagnostic  intelligent  decision  aid),  the  system  presented  in 
this  report,  could  make  a  contribution  to  BITE. 


Current  Approaches  to  Diagnostics 


Current  procedures  for  the  isolation  of  faults  In  electronic  components  fall 
between  two  extremes.  On  one  extreme,  diagnostic  stations  consist  of  large  col¬ 
lections  of  tools  and  fault  manuals.  This  approach  is  essentially  a  manual  test 
procedure.  On  the  other  extreme,  computer-controlled  test  equipment,  driven  by 
highly  specialized  programs,  are  used  in  an  attempt  to  completely  remove  the 
technician  from  the  diagnostic  process.  The  manual  process  requires  skilled 
personnel  while  automation  is  very  expensive  and  as  changes  occur  in  components, 
test  programs  can  be  rendered  useless  and  must  be  reprogrammed  at  great  expense. 
Most  successful  diagnostic  environments  contain  a  mix  of  both  manual  and  auto¬ 
mated  strategies.  The  mix  is  usually  dictated  by  the  cost  of  automation  and  the 
availability  of  skilled  personnel. 

Looking  at  testing  from  the  AI/Kxpert  Systems  perspective,  a  test  procedure 
can  be  viewed  as  a  sequence  of  calls  to  stimulus-response  procedures.  The  order 
of  these  calls  is  driven  by  component-specific  if-then  rule  sets. 

In  their  most  primitive  form,  these  test  procedures  are  paperbound  manuals 
which  provide  detailed  specifications  consisting  of  schematics  and  sequences  of 
input/output  reading  on  test  points  on  the  unit  under  test  (UUT).  Automatic  test 
equipment  (ATE),  called  test  program  sets,  are  collections  of  hardware  and  soft¬ 
ware  that  provide  high-level  functions  to  perform  stimulus-response  1/0  with  the 
UUT. 


Problems  With  Current  ATE  Environments 


One  important  problem  with  existing  ATE  environments  is  the  unnnt  rol  lable 
cost  associated  with  the  development  of  required  hardware  and  software.  There  is 
difficulty  in  all  areas  of  software  development,  to  properly  forecast  software 
and  hardware  costs,  but  especially  in  the  maintenance  and  diagnostic  domain,  due 
to  complexity.  Other  major  proolems  with  existing  ATE  are  as  follows: 

1.  Lack  of  portability  of  the  resulting  systems 

2.  The  required  hardware  and  software  for  current  ATE  environments  is 
too  cumbersome  and  rigid  for  future  needs.  The  ATE  environment  of  the  future 
will  require  compact  hardware  and  manageable  software. 

3.  Current  ATE  systems  lack  a  standard  maintenance  and  diagnostic  soft¬ 
ware  development  process.  The  complexity  of  the  maintenance  and  diagnostic 
domain  forced  personnel  to  produce  expert-like  systems  which  incorporated  and 
maintained  the  large  and  complex  knowledge  bases  before  there  were  good  tools 
available.  This  situation  was  further  complicated  when  expert  system  development 
tools  became  available,  because  there  was,  and  still  is,  a  resistance  to  convert 
from  the  traditional  though  cumbersome  ATE  environments  to  an  environment  which 
embodies  advances  in  recent  AI  technology.  Although  such  resistance  is  a  common 
human  trait,  it  cannot  withstand  the  economic  pressures  of  today's  Army. 


Al/Expert  Systems  and  Tool  Selection 


To  improve  the  performance  and  reduce  the  cost  of  current  ATE  environments, 
it  is  necessary  to  incorporate  AI/Expert  System  technology  into  maintenance  and 
diagnostic  activities. 

Expert  systems  consist  of  a  knowledge  base,  a  control  strategy,  and  an 
inference  engine.  The  knowledge  base  is  developed  by  a  knowledge  engineer  who 
extracts  rules  or  examples  from  the  domain  expert.  The  control  strategy  selects 
from  among  the  various  rule  sets  to  establish  the  validity  of  a  premise.  The 
inference  engine  is  the  low-level  reasoning  strategy  or  pattern  matching  tech¬ 
nique  for  deciding  which  knowledge  to  use  when  making  decisions. 

The  experience  gained  from  constructing  expert  systems  indicates  that  knowl¬ 
edge  base  development  is  the  key  to  an  effective  expert  system.  A  number  of 
approaches  to  knowledge  acquisition  have  been  tried  (ref  1)  but  all  have  been 
extremely  time  consuming.  The  easiest  form  of  knowledge  acquisition  for  both  the 
knowledge  engineer  and  the  domain  expert  is  by  example.  Therefore,  an  important 
decision  in  the  development  of  an  expert  system  is  to  use  an  expert  system  devel¬ 
opment  tool  which  allows  the  construction  of  the  data  base  by  means  of  examples. 
RuleMaster  (ref  2)  is  an  expert  system  development  tool  which  allows  this  type  of 
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knowledge  acquisition.  For  this  reason  and  many  others,  RuleMaster  was  chosen  as 
the  starting  point  for  the  development  of  the  MADTDA  system. 


DISCUSSION 


.'elevant  Literature 

There  are  several  research  studies  that  are  relevant  :  loiot  Services  Work¬ 

shop  on  Artificial  Intelligence  in  Maintenance  (ref  1)  and  SRI  '"Army  Study  (ref 
4);  expert  system  development  is  presented  in  reference  1;  surveys  .>!  expert 
systems  and  ATF,  applications  can  be  found  in  references  1  through  !  >;  and  the 
inductive  approach  to  knowledge  acquisition  is  discussed  in  references  i1  tud  !1. 

HADIDA 

MADIDA  is  a  project  started  in  lDPfS.  The  overall  project  goal  is  to  embed 
recent  advances  from  artificial  intelligence  research  into  a  user-f r i end! v  main¬ 
tenance  and  diagnostic  development  environment.  The  svstem  presentlv  performs 
diagnostic  test  procedures  to  isolate  faulty  pins  and  channels  in  a  circuit 
board . 

This  year's  project  goal  was  to  research  and  develop  a  system  framework  that 
integrates  a  graphics  subsystem  (containing  its  own  data  base)  into  a  data  base 
of  rule  sets  generated  from  examples  provided  by  experts. 

The  procedures  for  the  isolation  of  faults  in  components  fall  between  two 
extremes:  manual  testing  and  automatic  testing.  This  spectrum  of  fault  diagno¬ 

sis,  from  no  automation  testing  to  computer-controlled  testing,  does  not  provide 
the  versatility  needed  to  cost  effectively  diagnose  circuit  boards.  MADTDA  is  an 
environment  which  can  be  used  to  offer  the  maintenance  and  diagnostic  personnel 
an  alternative  that  allows  facilities  to  incorporate  various  degrees  of  automa¬ 
tion  throughout  their  activities. 

Where  MADIDA  and  ATE  Fit  Into  the  Maintenance  and  Diagnostic  Domain 

The  most  popular  maintenance  and  diagnostic  tool  presently  being  used  in 
this  area  is  ATE.  Presentlv  MADTDA  can  be  used  as  a  stand-alone  system  and  in 
the  future  can  be  made  to  work  in  conjunction  with  the  automatic  test  equipment 
used  to  diagnose  circuit  boards. 

The  MADIDA  system  can  be  used  in  three  different  areas  of  the  main¬ 
tenance  and  diagnostic  domain. 

1.  Environments  where  ATE  does  not  exist.  Those  facilities  do  not 
find  it  cost  effective  to  buv  ATE  environments  because  even  though  they  diagnose 


a  large  number  of  boards,  they  do  only  a  small  quantity  of  each  board  type. 
MADIDA  would  be  a  cost  effective  alternative  to  those  ATE  environments,  costing 
approximately  $2,000  for  a  microcomputer  (IBM-PC  or  compatible),  $700  for  a 
graphics  package  (OKS),  and  $4,500  for  RuleMaster,  for  a  minimum  system. 

2.  Existing  ATE  environments.  ATLAS  programs  (software  that  runs 

on  ATE)  perform  fault  diagnosis  on  boards  down  to  a  predefined  diagnostic  test 

procedure.  The  level  of  diagnosis  is  dependent  on  the  amount  a  facility  is  wil¬ 

ling  to  spend  on  the  development  of  hardware  and  software  for  the  ATE.  MADIDA 
could  take  the  results  from  ATLAS  programs  and  run  diagnostic  test  procedures  to 
go  one  level  beyond  the  ATLAS  program. 

3.  Maintenance  and  diagnostic  domain  where  ATE  exists  for  some 

boards  but  would  not  be  cost  effective  to  have  all  boards  analyzed  bv  ATE. 

MADIDA  could  perform  diagnostic  test  procedures  on  boards  that  would  not  be  cost 

effectively  analyzed  by  ATE. 


MADIDA  Architecture 


The  system  architecture  for  the  MADIDA  system  will  be  discussed  in  two 
parts:  (1)  diagnostic  rule  subsystem  and  (2)  the  graphics  support  system  (fig. 
1). 


1.  Diagnostic  rule  subsystem  consists  of  four  basic  modules: 

•  Sets  of  examples 

•  Induction  algorithms 

•  Rule  base 

•  Uncertainty  functions 

The  set-of-examples  module  consists  of  the  collection  of  examnles  given 
bv  maintenance  and  diagnostic  experts.  These  instances  can  be  nonmonotonic  in 
nature,  allowing  the  expert  to  associate  degrees  of  uncertainty  with  the  exam¬ 
nles.  The  induction-algorithms  module  produces  a  knowledge  base  of  rules  from 
the  data  provided  in  the  set-of-examples  module.  Quinlan's  ID3  algorithm  (ref 
11)  is  used  to  produce  the  hierarchy  of  decision  trees  from  the  given  examples. 
The  rule-hase  module  contains  the  sets  of  rules  generated  from  the  induction 
algorithms.  Roth  forward  and  backward  chaining  control  strategies  are  applied  to 
these  rules  during  the  various  diagnostic  test  procedures.  The  uncertainty- 
functions  module  applies  degrees  of  uncertainty  to  the  rules  in  the  knowledge 
base,  using  an  inference  network  to  reason  about  the  likelihood  of  the 
hvpotheses . 
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the  Radian  Corporation,  was  used  to  generate  MADIDA's  rule  base  from  maintenance 
and  diagnostic  expert  examples. 


MADIDA's  rule  base  consists  of  135  leaf-nodes.  Each  leaf-node  can  be  viewed 
as  one  (fairlv  complex)  rule.  The  graphics  support  package  consists  of  1200 
lines  of  C  source,  and  the  graphics  development  package  consists  of  2500  lines  of 
C  source  code. 


Attributes  of  RuleMaster 


RuleMaster,  a  generic  expert  svstem  building  tool  developed  bv  the 
Radian  Corporation  of  Austin,  Texas,  was  chosen  for  this  project.  It  offered 
many  of  the  qualities  that  were  felt  would  be  necessarv  for  the  development  of  a 
successful  maintenance  and  diagnostic  expert  svstem. 

The  first  concern  was  to  use  a  tool  that  could  generate  knowledge  bases 
from  examnles  given  bv  domain  experts.  This  induction  process  is  an  important 
concept  in  expert  system  development,  since  experts  best  describe  their  knowledge 
through  examples.  RuleMaster  uses  Quinlan's  ID3  algorithm  (ref  10)  to  generate 
rules  from  examples,  narrowing  the  gap  befween  knowledge  engineer  and  the  domain 
expert.  The  second  concern  was  to  build  a  working  tool  that  could  be  ported  to  a 
wide  range  of  computer  systems.  RuleMaster  has  been  ported  to  over  60  computers 
ranging  from  micros  to  mainframes.  The  third  concern  was  to  build  a  svstem  which 
had  the  abilitv  to  interface  with  other  languages,  computers,  hardware,  knowledge 
bases,  graphics  packages,  etc.  RuleMaster  gives  us  this  ability.  Currently 
MADTDA  works  with  Silicon  Graphics  primitives,  the  ”C"  programming  language,  and 
an  electronic  mouse.  The  last  major  concern  was  to  provide  a  relatively  inexpen¬ 
sive  tool  that  could  run  on  relatively  inexpensive  hardware.  Our  goal  is  to 
provide  a  portable  cost  effective  svstem  for  the  maintenance  and  diagnostic 
domain.  The  cost  of  RuleMaster  is  $4,500  for  a  single  user  svstem  and  $17,500 
for  a  multi-user  svstem.  RuleMaster  is  compatible  with  computers  ranging  from 
^2,ooo  for  an  THM-!’C  (or  compatible)  to  $5nn,000  VAX  machines. 

RuleMaster  also  can  generate  C  and  Fortran  source  codes.  This  can  he 
used  to  produce  real-time  execution  svstems  for  use  in  on-hoard  diagnostics  as 
well  ns  to  port  completed  systems  to  R0  class  CP's. 


Extending  RuleMaster  With  Uncertainty 
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In  f'Ovrt  systems,  evidence  and  hypotheses  are  often  linked,  hv  rules. 
E  »ch  rule  is  assoe  i  it  ed  with  a  number  to  quantity  the  certainty  degree  of  the 


rule.  These  rii7es  are  connect  ed  into  in  infi.Ti"irt-  network,  which  is  used  bv  the 
system's  inference  engine  t  >  reason  about  the  likelihood  of  the  hynotheses.  A 
simple  inference  network  is; 
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where  h  =  hvnnthesis,  e  -  evidence,  md  r  --  rule. 

To  implement  this  idea  into  kuleMaster,  each  node  (e,  h)  and  each  link 
( r)  in  the  inference  network  will  he  i  mpl  evented  as  a  module  that  will  he  organ¬ 
ized  into  a  hi  era  rein'  similar  to  the  inference  network.  Sequential  and  parallel 
combination  modules  will  be  integrated  into  the  hierarchy  to  combine  certainty 
factors  in  two  different  situations  and  return  the-  combined  certainty  factor 
(CM  . 

The  transition  from  one  state  to  the  next  in  a  deterministic  state  auto¬ 
maton  ( D  FS  A )  will  require  two  additional  actions  to  he  carried  out:  (1)  call 
its  antecedent  module,  which  returns  the  C,K  of  the  antecedent  module,  (2)  call 
the  sequential  c<  nhination  module  to  compute  the  CF  of  the  inferred  hypothesis 
from  the  antecedent's  CF  and  the  rule's  CF. 


CONCLUSIONS 

The  M.VMOA  system  offers  the  maintenance  and  li  avnostic  domain  an  alterna¬ 
tive  to  the  two  current  tvnes  of  test  in/,  nrocedures :  manual  testing  and  auto¬ 
matic  testin".  MADTFIA  can  he  1  nmrnorated  into  m.ai  nt  en  mre  and  diagnostic  domain 
and  offer  a  spectrum  of  increasin/l  .•  uito-nated  diagnostic  procedures.  This  spec- 
t  rum  will  permit  di  agues  r  i  r  testin'1  to  he  .•  irried  out  in  a  cost  effective  manner 
hv  allowing  facilities  various  degrees  >'  aut  omat i on . 

There  ire  several  nrojeef  goals  ‘  ir  1  '->u7  .  o’  these  goals  a  re  : 

I.  Implementation  of  to  iatereuce  network  into  the  existing  hierarchs’ 
to  integrate  uncertain  examnl  es  info  t  he  buiwle  t  ■■  h  is,  . 
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2.  Integration  of  additional  diagnostic  test  procedures  into  the  knowl¬ 
edge  base,  permitting  board  diagnosis  to  be  performed  at  a  lower  level. 

3.  Coordination  of  several  graphics  data  bases;  as  the  diagnostic  test 
procedure  proceeds  from  board  diagnosis  to  component  diagnosis  to  chip  diagnosis, 
etc.,  MADIDA  can  invoke  the  various  graphics  data  bases  to  display  the  section  of 
the  circuit  board  currently  under  study. 

4.  Integration  of  MADIDA  into  the  automatic  test  equipment  environment. 
MADIDA's  hardware  will  be  physically  connected  to  existing  automatic  testing 
equipment  (ATE),  and  use  the  results  from  the  ATLAS  program  to  perform  lower- 
level  diagnostic  test  procedures.  Also,  we  hope  to  use  some  of  the  ATLAS  primi¬ 
tives  to  get  readings  from  the  circuit  board  under  test  and  then  incorporate  the 
data  into  MADIDA's  decision  making  process. 

5.  Currently,  MADIDA  encodes  only  surface  level  knowledge.  In  the 
future,  we  hope  to  integrate  deep-level  domain  knowledge  into  the  system  and  have 
these  two  forms  of  knowledge  representation  work  in  conjunction  with  each  other. 
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